The effect of unlabeled samples in reducing the small sample size problem and mitigating the Hughes phenomenon

نویسندگان

  • Behzad M. Shahshahani
  • David A. Landgrebe
چکیده

In this paper, we study the use of unlabeled samples in reducing the problem of small training sample size that can severely affect the recognition rate of classifiers when the dimensionality of the multispectral data is high. We show that by using additional unlabeled samples that are available at no extra cost, the performance may be improved, and therefore the Hughes phenomenon can be mitigated. Furthermore, by experiments, we show that by using additional unlabeled samples more representative estimates can be obtained. We also propose a semiparametric method for incorporating the training (i.e., labeled) and unlabeled samples simultaneously into the parameter estimation process.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Design of an Adaptive Classification Procedure for the Analysis of High-Dimensional Data with Limited Training Samples

.......................................................................................................................................................... V CHAPTER 1: INTRODUCTION ..................................................................................................................... 1 CHAPTER 2: EFFECT OF SEMI-LABELED SAMPLES IN REDUCING THE SMALL SAMPLE SIZE PROBLEM AND MITIGATI...

متن کامل

Lowpass Filter For Increasing Class Separability

In remote sensing, the number of training samples is often limited. For hyperspectral data, it becomes more difficult to obtain accurate estimates of class statistics because of the small ratio of the training sample size to dimensionality. Generally speaking, classification performance depends on four factors: class separability, the training sample size, dimensionality, and classifier type (o...

متن کامل

کاهش ابعاد داده‌های ابرطیفی به منظور افزایش جدایی‌پذیری کلاس‌ها و حفظ ساختار داده

Hyperspectral imaging with gathering hundreds spectral bands from the surface of the Earth allows us to separate materials with similar spectrum. Hyperspectral images can be used in many applications such as land chemical and physical parameter estimation, classification, target detection, unmixing, and so on. Among these applications, classification is especially interested. A hyperspectral im...

متن کامل

High performance of the support vector machine in classifying hyperspectral data using a limited dataset

To prospect mineral deposits at regional scale, recognition and classification of hydrothermal alteration zones using remote sensing data is a popular strategy. Due to the large number of spectral bands, classification of the hyperspectral data may be negatively affected by the Hughes phenomenon. A practical way to handle the Hughes problem is preparing a lot of training samples until the size ...

متن کامل

A Meta-analysis of the Effectiveness of Psychological Interventions in Reducing Emotional Problems in Students with Specific Learning Disorders in the Period of 2009-2018

Due to their mistakes while learning, students with specific learning disorders continually show signs of stress and, compared to normal students, more emotional problems and lower self-confidence. This makes the discovery of the most appropriate forms of psychological interventions aiming to reduce these students' emotional problems even more essential. The present research intends to study th...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • IEEE Trans. Geoscience and Remote Sensing

دوره 32  شماره 

صفحات  -

تاریخ انتشار 1994